00000100:00100000:3.0F:1782487602.498739:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299320448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782487602.498820:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487602.498915:0:198596:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299320448 00000100:00100000:3.0:1782487602.498922:0:198596:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299320448 00000100:00100000:3.0:1782487602.498979:0:198596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1782487602.498990:0:198596:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066299320448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782487602.499026:0:198596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 37158912 pending 0 free 3847225344 avail 3845128192 00000100:00100000:3.0:1782487602.499088:0:198596:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066299320448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487602.499097:0:198596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1782487602.499153:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299320448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0F:1782487602.561707:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487603.585770:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487603.794696:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487603.795514:0:190302:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294453376 00000100:00100000:3.0:1782487603.795523:0:190302:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294453376 00000100:00100000:3.0:1782487603.795575:0:190302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1171 00000100:00100000:3.0:1782487603.795585:0:190302:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2360:x1869066294453376:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487603.795645:0:190302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487603.795664:0:190302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85ee62 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478516 expref: -99 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798520:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee69 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798539:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee69 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798551:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee69 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798588:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690800/0x66475b4e8b85ee70 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798595:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690800/0x66475b4e8b85ee70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798602:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690800/0x66475b4e8b85ee70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798864:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee69 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798873:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee69 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798880:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee69 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798887:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487603.798892:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee69 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798900:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee69 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798914:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487603.798918:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487603.798923:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee69 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798929:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee69 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798945:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690800/0x66475b4e8b85ee70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798951:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690800/0x66475b4e8b85ee70 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798956:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690800/0x66475b4e8b85ee70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798961:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487603.798964:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690800/0x66475b4e8b85ee70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798969:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690800/0x66475b4e8b85ee70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798977:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x141795a8 (ffff9cb579f0f000) 00010000:00010000:3.0:1782487603.798979:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487603.798982:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690800/0x66475b4e8b85ee70 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.798987:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690800/0x66475b4e8b85ee70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.799021:0:190302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85ee62 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478516 expref: 552 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.799030:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487603.799032:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487603.799040:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85ee62 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478516 expref: 552 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487603.799059:0:190302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4de691400, rc -2) 00000100:00100000:3.0:1782487603.799179:0:190302:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2360:x1869066294453376:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 3594us (4491us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782487603.799188:0:190302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1171 00010000:00010000:3.0:1782487604.609763:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1782487605.330354:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487605.330413:0:213217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294453504 00000100:00100000:0.0:1782487605.330422:0:213217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294453504 00000100:00100000:0.0:1782487605.330486:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1172 00000100:00100000:0.0:1782487605.330499:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2363:x1869066294453504:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487605.330542:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487605.330563:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee77 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47851d expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.330694:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee7e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.330710:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.330733:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.330750:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.330758:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.330766:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331098:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331107:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee7e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331123:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee7e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331130:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487605.331136:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee7e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331143:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee7e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331157:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487605.331161:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487605.331166:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee7e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331173:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee7e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331187:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331194:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee85 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331201:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331208:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487605.331211:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331227:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331237:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x141795a8 (ffff9cb4c4862900) 00010000:00010000:0.0:1782487605.331240:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487605.331243:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee85 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331250:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331283:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee77 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47851d expref: 68 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331295:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487605.331298:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487605.331303:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee77 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47851d expref: 68 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487605.331315:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e800, rc -2) 00000100:00100000:0.0:1782487605.331380:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2363:x1869066294453504:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 884us (1035us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487605.331390:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1172 00010000:00010000:0.0:1782487605.634070:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487605.845195:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487605.845643:0:190292:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294453632 00000100:00100000:0.0:1782487605.845651:0:190292:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294453632 00000100:00100000:0.0:1782487605.845700:0:190292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 338 00000100:00100000:0.0:1782487605.845708:0:190292:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60894528-77cf-40cf-92ce-b54cc4bbae30+13:2362:x1869066294453632:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1782487605.845779:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487605.845794:0:190292:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60894528-77cf-40cf-92ce-b54cc4bbae30+13:2362:x1869066294453632:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487605.845802:0:190292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 338 00000100:00100000:0.0:1782487605.845868:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487605.845891:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487605.845908:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487605.845923:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294453760 00000100:00100000:0.0:1782487605.845926:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294453760 00000100:00100000:0.0:1782487605.845953:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294454144 00000100:00100000:0.0:1782487605.845955:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294454144 00000100:00100000:0.0:1782487605.845971:0:190296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 438 00000100:00100000:0.0:1782487605.845977:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2363:x1869066294453760:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1782487605.846017:0:190298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 439 00000100:00100000:0.0:1782487605.846024:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2363:x1869066294453760:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 45us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487605.846048:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2362:x1869066294454144:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487605.846048:0:190296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 438 00000100:00080000:0.0:1782487605.846064:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782487605.846085:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2362:x1869066294454144:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 59us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487605.846094:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294453888 00000100:00100000:3.0:1782487605.846095:0:190298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 439 00000100:00100000:0.0:1782487605.846100:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294453888 00000100:00100000:0.0:1782487605.846127:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294454016 00000100:00100000:0.0:1782487605.846129:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294454016 00000100:00100000:0.0:1782487605.846146:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 272 00000100:00100000:0.0:1782487605.846153:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2362:x1869066294453888:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487605.846179:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2362:x1869066294453888:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487605.846185:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 272 00000100:00100000:0.0:1782487605.846196:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 273 00000100:00100000:0.0:1782487605.846207:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2363:x1869066294454016:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487605.846227:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2363:x1869066294454016:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 21us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487605.846232:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 273 00000100:00080000:0.0:1782487605.846248:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782487605.846251:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782487605.846585:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487605.846636:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294454272 00000100:00100000:0.0:1782487605.846640:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294454272 00000100:00100000:0.0:1782487605.846672:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 274 00000100:00100000:0.0:1782487605.846679:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:2362:x1869066294454272:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1782487605.846689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487605.846705:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:2362:x1869066294454272:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 25us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487605.846711:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 274 00000100:00100000:0.0:1782487605.846724:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294454400 00000100:00100000:0.0:1782487605.846727:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294454400 00000100:00100000:0.0:1782487605.846750:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 275 00000100:00100000:0.0:1782487605.846756:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:2363:x1869066294454400:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487605.846775:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:2363:x1869066294454400:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 19us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487605.846782:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 275 00000100:00080000:0.0:1782487605.846797:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782487605.846800:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782487606.356117:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.356150:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294454528 00000100:00100000:0.0:1782487606.356158:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294454528 00000100:00100000:0.0:1782487606.356206:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1173 00000100:00100000:0.0:1782487606.356215:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2361:x1869066294454528:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487606.356263:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487606.356281:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee8c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478524 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356331:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee93 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356345:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee93 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356356:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee93 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356371:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356378:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356384:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356600:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee93 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356634:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee93 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356641:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356647:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.356656:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356664:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee93 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356676:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.356679:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.356683:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee93 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356691:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85ee93 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356702:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356708:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee9a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356714:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356719:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.356722:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356728:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356734:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x141795a8 (ffff9cb4c4862900) 00010000:00010000:0.0:1782487606.356736:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.356743:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee9a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356749:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356775:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee8c lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478524 expref: 552 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356783:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.356786:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487606.356789:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee8c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478524 expref: 552 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.356798:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3f400, rc -2) 00000100:00100000:0.0:1782487606.356850:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2361:x1869066294454528:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 636us (743us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487606.356859:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1173 00000100:00100000:3.0:1782487606.492759:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.495315:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294454656 00000100:00100000:0.0:1782487606.495326:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294454656 00000100:00100000:0.0:1782487606.495419:0:213935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1883 00000100:00100000:0.0:1782487606.495429:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:295211:x1869066294454656:12345-192.168.202.21@tcp:101:rm.0 00010000:00010000:0.0:1782487606.495448:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487606.495466:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85eea1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47852b expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.495538:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85eea8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.495569:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85eea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.495580:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85eea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487606.495761:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x35:0x0]: returning size 7680 00000004:00200000:0.0:1782487606.495764:0:213935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487606.495831:0:213935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85eea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.495855:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85eea1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47852b expref: 69 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.495871:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85eea8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47852b expref: 68 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.495880:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.495883:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782487606.495886:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e800, rc 0) 00000100:00100000:0.0:1782487606.495938:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+68:295211:x1869066294454656:12345-192.168.202.21@tcp:101:rm.0 Request processed in 510us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.495945:0:213935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1883 00000100:00100000:3.0:1782487606.503785:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.506130:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294454912 00000100:00100000:0.0:1782487606.506141:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294454912 00000100:00100000:0.0:1782487606.506190:0:190296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1884 00000100:00100000:0.0:1782487606.506199:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+68:295211:x1869066294454912:12345-192.168.202.21@tcp:101:rm.0 00010000:00010000:0.0:1782487606.506218:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487606.506245:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85eeaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478532 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487606.506463:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x35:0x0]: returning size 7680 00010000:00010000:0.0:1782487606.506660:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85eeaf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478532 expref: 70 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.506674:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cb44981b800) 00010000:00010000:0.0:1782487606.506677:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782487606.506682:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85eeaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478532 expref: 70 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.506693:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3f400, rc 0) 00000100:00100000:0.0:1782487606.510101:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+69:295211:x1869066294454912:12345-192.168.202.21@tcp:101:rm.0 Request processed in 3894us (6314us total) trans 8589957021 rc 301/301 00000100:00100000:0.0:1782487606.510112:0:190296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1884 00000100:00100000:3.0:1782487606.513787:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.513853:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294455040 00000100:00100000:0.0:1782487606.513863:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294455040 00000100:00100000:0.0:1782487606.513936:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5805 00000100:00100000:0.0:1782487606.513949:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560bc6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+69:295211:x1869066294455040:12345-192.168.202.21@tcp:37:rm.0 00000100:00100000:0.0:1782487606.521266:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560bc6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+69:295211:x1869066294455040:12345-192.168.202.21@tcp:37:rm.0 Request processed in 7312us (7477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.521278:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5805 00000100:00100000:3.0:1782487606.523744:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.523795:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294455296 00000100:00100000:0.0:1782487606.523803:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294455296 00000100:00100000:0.0:1782487606.523855:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5806 00000100:00100000:0.0:1782487606.523867:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+69:295211:x1869066294455296:12345-192.168.202.21@tcp:35:rm.0 00000100:00100000:0.0:1782487606.524391:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+70:295211:x1869066294455296:12345-192.168.202.21@tcp:35:rm.0 Request processed in 525us (649us total) trans 8589957022 rc 0/0 00000100:00100000:0.0:1782487606.524399:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5806 00000100:00100000:3.0:1782487606.526141:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.527116:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294455552 00000100:00100000:0.0:1782487606.527123:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294455552 00000100:00100000:0.0:1782487606.527182:0:213684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1885 00000100:00100000:0.0:1782487606.527192:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+70:295211:x1869066294455552:12345-192.168.202.21@tcp:101:rm.0 00010000:00010000:0.0:1782487606.527210:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487606.527226:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85eebd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478539 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.527437:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85eec4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.527452:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85eec4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.527466:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85eec4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487606.527485:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x35:0x0]: returning size 7680 00010000:00010000:0.0:1782487606.527664:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85eebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478539 expref: 73 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.527680:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85eec4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478539 expref: 72 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.527687:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.527695:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782487606.527698:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3f200, rc 0) 00000100:00100000:0.0:1782487606.527751:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+72:295211:x1869066294455552:12345-192.168.202.21@tcp:101:rm.0 Request processed in 561us (1612us total) trans 8589957023 rc 0/0 00000100:00100000:0.0:1782487606.527757:0:213684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1885 00000100:00100000:3.0:1782487606.531783:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.531904:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294455680 00000100:00100000:0.0:1782487606.531916:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294455680 00000100:00100000:0.0:1782487606.531974:0:213218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1886 00000100:00100000:0.0:1782487606.531986:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+72:295211:x1869066294455680:12345-192.168.202.21@tcp:41:rm.0 00000004:00000024:0.0:1782487606.532056:0:213218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7666139136 avail 7661944832 00000100:00100000:0.0:1782487606.532127:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+72:295211:x1869066294455680:12345-192.168.202.21@tcp:41:rm.0 Request processed in 142us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.532136:0:213218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1886 00000100:00100000:3.0:1782487606.534682:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.535071:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294455808 00000100:00100000:0.0:1782487606.535078:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294455808 00000100:00100000:0.0:1782487606.535116:0:190296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1887 00000100:00100000:0.0:1782487606.535124:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+72:295211:x1869066294455808:12345-192.168.202.21@tcp:101:rm.0 00010000:00010000:0.0:1782487606.535141:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487606.535159:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85eed2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478540 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535211:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85eed9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535224:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85eed9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535235:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85eed9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535261:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85eee0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535269:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85eee0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535275:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85eee0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535626:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85eee7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535637:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85eee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535645:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85eee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487606.535675:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb17:0x0]: returning size 0 00000004:00200000:0.0:1782487606.535679:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487606.535694:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85eee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535704:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85eee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535713:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85eed9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535719:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85eed9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535736:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85eed9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535742:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.535746:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85eed9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535753:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85eed9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535765:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.535768:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.535772:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85eed9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535779:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85eed9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535790:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85eee0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535796:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85eee0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535802:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85eee0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535807:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.535810:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85eee0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535825:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85eee0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535832:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb4c4862900) 00010000:00010000:0.0:1782487606.535834:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.535837:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85eee0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535842:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85eee0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535868:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85eed2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478540 expref: 74 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535879:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85eee7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478540 expref: 73 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.535886:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:0.0:1782487606.535888:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487606.535891:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3ee00, rc 0) 00000100:00100000:0.0:1782487606.535941:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:295211:x1869066294455808:12345-192.168.202.21@tcp:101:rm.0 Request processed in 818us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.535948:0:190296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1887 00000100:00100000:3.0:1782487606.538706:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.539056:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294456064 00000100:00100000:0.0:1782487606.539064:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294456064 00000100:00100000:0.0:1782487606.539102:0:190298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1888 00000100:00100000:0.0:1782487606.539110:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:295211:x1869066294456064:12345-192.168.202.21@tcp:36:rm.0 00010000:00010000:0.0:1782487606.539160:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487606.539179:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85eee7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478540 expref: 73 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539195:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:0.0:1782487606.539204:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85eea8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47852b expref: 72 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539212:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.539215:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487606.539230:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85eeee lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539241:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85eeee lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539249:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85eeee lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539261:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85eef5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539268:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85eef5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539274:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85eef5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539536:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539556:0:190298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783d4 expref: 550 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539565:0:190298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478348 expref: 550 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539574:0:190298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478444 expref: 550 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539582:0:190298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478413 expref: 550 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539590:0:190298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784e5 expref: 550 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539598:0:190298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 8/0,1 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539641:0:190298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784e5 expref: 550 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539653:0:190298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784e5 expref: 550 pid: 190299 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.539666:0:190298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44b4d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299320576:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.539745:0:190298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478413 expref: 550 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539760:0:190298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478413 expref: 550 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.539770:0:190298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb45a60aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299320704:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.539796:0:190298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478444 expref: 550 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539804:0:190298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478444 expref: 550 pid: 190303 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.539812:0:190298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54765ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299320832:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.539832:0:190298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478348 expref: 550 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539840:0:190298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478348 expref: 550 pid: 213217 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.539848:0:190298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46eabed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299320960:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.539867:0:190298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783d4 expref: 550 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.539875:0:190298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783d4 expref: 550 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.539894:0:190298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546d6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299321088:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487606.539912:0:190298:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aaba900 going to sleep for 11 seconds 00000100:00100000:3.0:1782487606.542291:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487606.542314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487606.542353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487606.542369:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487606.542392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487606.542411:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294456192 00000100:00100000:3.0:1782487606.542417:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294456192 00010000:00010000:3.0:1782487606.542446:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784e5 expref: 551 pid: 190299 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.542469:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294456320 00000100:00100000:3.0:1782487606.542471:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294456320 00010000:00010000:3.0:1782487606.542481:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478413 expref: 552 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.542503:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294456576 00000100:00100000:3.0:1782487606.542505:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294456576 00010000:00010000:3.0:1782487606.542516:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478348 expref: 553 pid: 213217 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.542525:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294456448 00000100:00100000:3.0:1782487606.542527:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294456448 00010000:00010000:3.0:1782487606.542536:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478444 expref: 554 pid: 190303 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.542545:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294456704 00000100:00100000:3.0:1782487606.542547:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294456704 00010000:00010000:3.0:1782487606.542556:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783d4 expref: 555 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.542567:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6542 00000100:00100000:3.0:1782487606.542575:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579992850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+555:2360:x1869066294456192:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.542591:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.542597:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784e5 expref: 555 pid: 190299 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542625:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784e5 expref: 555 pid: 190299 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542644:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:3.0:1782487606.542648:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542655:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.542659:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784e5 expref: 555 pid: 190299 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542661:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487606.542673:0:190298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44b4d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299320576:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487606.542682:0:190298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb45a60aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299320704:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487606.542689:0:190298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54765ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299320832:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487606.542693:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579992850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+554:2360:x1869066294456192:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 119us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.542696:0:190298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46eabed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299320960:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487606.542700:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6542 00000100:00100000:0.0:1782487606.542702:0:190298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546d6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299321088:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.542727:0:190298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.542737:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6543 00000100:00100000:3.0:1782487606.542744:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+553:2361:x1869066294456320:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.542751:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.542756:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478413 expref: 553 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542765:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478413 expref: 553 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542788:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478413 expref: 553 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542798:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:3.0:1782487606.542802:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542809:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542815:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.542832:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+552:2361:x1869066294456320:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 89us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.542839:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6543 00000100:00100000:3.0:1782487606.542851:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6544 00000100:00100000:3.0:1782487606.542857:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549167480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2361:x1869066294456576:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.542864:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.542869:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478348 expref: 551 pid: 213217 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542878:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478348 expref: 551 pid: 213217 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542890:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478348 expref: 551 pid: 213217 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542909:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:3.0:1782487606.542913:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542920:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542925:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.542940:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549167480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+550:2361:x1869066294456576:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 84us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.542946:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6544 00000100:00100000:3.0:1782487606.542956:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6545 00000100:00100000:3.0:1782487606.542962:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549164a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+549:2361:x1869066294456448:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.542968:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.542972:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478444 expref: 549 pid: 190303 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542982:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478444 expref: 549 pid: 190303 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.542994:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478444 expref: 549 pid: 190303 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.543005:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:3.0:1782487606.543008:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.543019:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.543037:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.543054:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549164a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+548:2361:x1869066294456448:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 92us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.543061:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6545 00000100:00100000:3.0:1782487606.543072:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6546 00000100:00100000:3.0:1782487606.543078:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+547:2360:x1869066294456704:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.543085:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.543090:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783d4 expref: 547 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.543099:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783d4 expref: 547 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.543111:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783d4 expref: 547 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.543120:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:3.0:1782487606.543123:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.543130:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.543137:0:190284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.543167:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.543184:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+546:2360:x1869066294456704:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 106us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.543190:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6546 00010000:00010000:0.0:1782487606.543638:0:190298:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.543646:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487606.544438:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2562, 64 off172160 00000004:00080000:0.0:1782487606.544447:0:190298:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7233965839092ns, next at 7234965837324ns, rc = 0 00010000:00010000:0.0:1782487606.544503:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef03 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.544515:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.544530:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.544538:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef03 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.544544:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef03 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.544551:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef03 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.544577:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487606.544595:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.544602:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.544634:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.544640:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fe00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487606.544641:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487606.544644:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.544646:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef03 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.544651:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.544652:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487606.544655:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef03 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.544661:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:0.0:1782487606.544663:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487606.547087:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.547097:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85eefc lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.547122:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85eeee lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.547129:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85eeee lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.547135:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85eeee lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.547141:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.547144:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85eeee lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.547151:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85eeee lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.547162:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.547165:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.547168:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85eeee lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.547174:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85eeee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487606.547183:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000797875b0 reply state 0000000099282cce transno 8589957024 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85eef5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.547203:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487606.547285:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:295211:x1869066294456064:12345-192.168.202.21@tcp:36:rm.0 Request processed in 8171us (8580us total) trans 8589957024 rc 0/0 00000100:00100000:0.0:1782487606.547294:0:190298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1888 00010000:00010000:3.0:1782487606.549799:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef03 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.549818:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:3.0:1782487606.549820:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487606.549825:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef03 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.549832:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef03 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.549855:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.549857:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.549859:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.550639:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85eef5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.550647:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85eef5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.550663:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85eef5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.550668:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487606.550672:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85eef5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.550679:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85eef5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.550688:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb4c4862500) 00010000:00010000:3.0:1782487606.550690:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487606.550693:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85eef5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.550696:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487606.550699:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85eef5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.550722:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294456832 00000100:00100000:0.0:1782487606.550729:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294456832 00000100:00100000:0.0:1782487606.550770:0:213218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1889 00000100:00100000:0.0:1782487606.550779:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+72:295211:x1869066294456832:12345-192.168.202.21@tcp:101:rm.0 00010000:00010000:0.0:1782487606.550800:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487606.550815:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef0a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478547 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.550905:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef11 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.550919:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef11 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.550929:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef11 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.550941:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef18 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.550948:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.550955:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551060:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef1f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551082:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551090:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487606.551119:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb18:0x0]: returning size 0 00000004:00200000:0.0:1782487606.551123:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487606.551138:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551148:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551156:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef11 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551162:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef11 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551169:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef11 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551174:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.551177:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef11 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551183:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef11 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551196:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.551199:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.551202:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef11 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551209:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef11 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551218:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551224:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef18 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551230:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551235:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.551238:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551244:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef18 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551250:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb4c4862900) 00010000:00010000:0.0:1782487606.551252:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.551255:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef18 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551260:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551289:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef0a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478547 expref: 74 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551301:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478547 expref: 73 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.551309:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb18:0x0].0x0 (ffff9cb4c14c1200) 00010000:00010000:0.0:1782487606.551311:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487606.551313:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e200, rc 0) 00000100:00100000:0.0:1782487606.551362:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:295211:x1869066294456832:12345-192.168.202.21@tcp:101:rm.0 Request processed in 584us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.551369:0:213218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1889 00000100:00100000:0.0:1782487606.553502:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.553546:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294457088 00000100:00100000:0.0:1782487606.553553:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294457088 00000100:00100000:0.0:1782487606.553625:0:190296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1890 00000100:00100000:0.0:1782487606.553637:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46eabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:295211:x1869066294457088:12345-192.168.202.21@tcp:36:rm.0 00010000:00010000:0.0:1782487606.553678:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487606.553697:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef1f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478547 expref: 73 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.553713:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb18:0x0].0x0 (ffff9cb4c14c1200) 00010000:00010000:0.0:1782487606.553718:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487606.553732:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef26 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.553757:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef26 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.553767:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef26 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.553791:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef2d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.553800:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.553808:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.553918:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.553930:0:190296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d0 expref: 545 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.553939:0:190296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.553970:0:190296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d0 expref: 545 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.553985:0:190296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d0 expref: 545 pid: 213491 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.554013:0:190296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54765ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:190296:1869066299321216:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487606.554110:0:190296:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb544e879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487606.555784:0:190296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54765ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:190296:1869066299321216:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.555809:0:190296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.556233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487606.556287:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294457216 00000100:00100000:3.0:1782487606.556293:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294457216 00010000:00010000:3.0:1782487606.556322:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d0 expref: 546 pid: 213491 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.556356:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6547 00000100:00100000:3.0:1782487606.556364:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+546:2360:x1869066294457216:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.556375:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.556382:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d0 expref: 546 pid: 213491 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.556405:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d0 expref: 546 pid: 213491 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.556423:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d0 expref: 546 pid: 213491 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.556436:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb18:0x0].0x0 (ffff9cb4c14c1200) 00010000:00010000:3.0:1782487606.556441:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.556450:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.556458:0:190284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.556473:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.556515:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+545:2360:x1869066294457216:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 152us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.556521:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6547 00010000:00010000:0.0:1782487606.556628:0:190296:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.556635:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487606.557188:0:190296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2556, 64 off171776 00000004:00080000:0.0:1782487606.557198:0:190296:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7233978590278ns, next at 7234978588177ns, rc = 0 00010000:00010000:0.0:1782487606.557253:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef3b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557264:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557273:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557280:0:190296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef3b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557287:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef3b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557299:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef3b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557312:0:190296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487606.557329:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557335:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557342:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557348:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.557352:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557359:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557367:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb18:0x0].0x0 (ffff9cb4c14c1200) 00010000:00010000:0.0:1782487606.557370:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487606.557373:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557379:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef34 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557393:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef26 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557407:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef26 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557413:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef26 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557417:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.557420:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef26 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557426:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef26 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557433:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.557435:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.557437:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef26 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.557443:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef26 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487606.557452:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005bd040ab reply state 00000000e7e22ced transno 8589957025 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.557460:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487606.557505:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46eabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+74:295211:x1869066294457088:12345-192.168.202.21@tcp:36:rm.0 Request processed in 3871us (4008us total) trans 8589957025 rc 0/0 00000100:00100000:0.0:1782487606.557512:0:190296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1890 00010000:00010000:3.0:1782487606.557632:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487606.557639:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef3b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.557646:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ee00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487606.557649:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef3b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.557665:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef3b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.557674:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb18:0x0].0x0 (ffff9cb4c14c1200) 00010000:00010000:3.0:1782487606.557676:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487606.557680:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef3b lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.557685:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85ef3b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.557694:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.557696:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.557697:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.558946:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.558956:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef2d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.558963:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef2d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.558969:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fe00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487606.558972:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef2d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.558979:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef2d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.558988:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb4c4862a00) 00010000:00010000:3.0:1782487606.558996:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487606.559000:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef2d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.559007:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef2d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.559206:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.559391:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294457344 00000100:00100000:0.0:1782487606.559398:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294457344 00000100:00100000:0.0:1782487606.559441:0:213684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1891 00000100:00100000:0.0:1782487606.559449:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:295211:x1869066294457344:12345-192.168.202.21@tcp:101:rm.0 00010000:00010000:0.0:1782487606.559466:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487606.559478:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef42 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47854e expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559535:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef49 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559546:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef49 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559555:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef49 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559567:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559574:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559580:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559704:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef57 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559714:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559721:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487606.559759:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb16:0x0]: returning size 0 00000004:00200000:0.0:1782487606.559763:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487606.559776:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559786:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559793:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef49 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559800:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef49 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559806:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559811:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.559814:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559820:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef49 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559828:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.559830:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.559833:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef49 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559839:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef49 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559857:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559863:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef50 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559869:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559874:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.559877:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559882:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef50 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559889:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4c4862900) 00010000:00010000:0.0:1782487606.559891:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.559894:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef50 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559899:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559921:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef42 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47854e expref: 75 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559932:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47854e expref: 74 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.559948:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:0.0:1782487606.559951:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487606.559953:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e200, rc 0) 00000100:00100000:0.0:1782487606.559987:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+74:295211:x1869066294457344:12345-192.168.202.21@tcp:101:rm.0 Request processed in 539us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.559994:0:213684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1891 00000100:00100000:0.0:1782487606.563795:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.563825:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294457600 00000100:00100000:0.0:1782487606.563833:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294457600 00000100:00100000:0.0:1782487606.563873:0:213218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1892 00000100:00100000:0.0:1782487606.563881:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+74:295211:x1869066294457600:12345-192.168.202.21@tcp:36:rm.0 00010000:00010000:0.0:1782487606.563928:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487606.563950:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ef57 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47854e expref: 74 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.563966:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:0.0:1782487606.563970:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487606.563986:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef5e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.563998:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564008:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564021:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564054:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564062:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564151:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564161:0:213218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783e9 expref: 544 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564170:0:213218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47834f expref: 544 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564178:0:213218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47844b expref: 544 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564186:0:213218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47841a expref: 544 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564193:0:213218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d7 expref: 544 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564201:0:213218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 8/0,1 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564228:0:213218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d7 expref: 544 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564248:0:213218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d7 expref: 544 pid: 190302 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.564262:0:213218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44b4d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299321344:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.564342:0:213218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47841a expref: 544 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564352:0:213218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47841a expref: 544 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.564361:0:213218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb45a53f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299321472:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.564385:0:213218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47844b expref: 544 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564393:0:213218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47844b expref: 544 pid: 190303 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.564402:0:213218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb45a53f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299321600:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.564422:0:213218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47834f expref: 544 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564430:0:213218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47834f expref: 544 pid: 213217 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.564451:0:213218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573532a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299321728:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.564475:0:213218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783e9 expref: 544 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.564483:0:213218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783e9 expref: 544 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.564491:0:213218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573530a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299321856:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487606.564507:0:213218:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aaba900 going to sleep for 11 seconds 00000100:00100000:0.0:1782487606.566801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.566847:0:213218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44b4d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299321344:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487606.566900:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294457728 00000100:00100000:3.0:1782487606.566905:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294457728 00010000:00010000:3.0:1782487606.566936:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d7 expref: 545 pid: 190302 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.566972:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6548 00000100:00100000:3.0:1782487606.566980:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+545:2363:x1869066294457728:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.566993:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.566999:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d7 expref: 545 pid: 190302 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.567010:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d7 expref: 545 pid: 190302 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.567040:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d7 expref: 545 pid: 190302 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.567054:0:190282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:3.0:1782487606.567059:0:190282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.567082:0:190282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.567089:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.567125:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+544:2363:x1869066294457728:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 145us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.567132:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6548 00000100:00100000:3.0:1782487606.571235:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487606.571259:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487606.571274:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487606.571356:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294457984 00000100:00100000:3.0:1782487606.571364:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294457984 00010000:00010000:3.0:1782487606.571398:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47841a expref: 544 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.571423:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294458112 00000100:00100000:3.0:1782487606.571425:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294458112 00010000:00010000:3.0:1782487606.571475:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47834f expref: 545 pid: 213217 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.571495:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294457856 00000100:00100000:3.0:1782487606.571497:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294457856 00010000:00010000:3.0:1782487606.571507:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47844b expref: 546 pid: 190303 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.571523:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6549 00000100:00100000:3.0:1782487606.571531:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579991050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+546:2361:x1869066294457984:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.571557:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.571563:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47841a expref: 546 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.571576:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47841a expref: 546 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.571596:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:3.0:1782487606.571601:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.571627:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.571633:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.571719:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579991050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+546:2361:x1869066294457984:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 187us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.571726:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6549 00000100:00100000:3.0:1782487606.571766:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6550 00000100:00100000:3.0:1782487606.571772:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+545:2363:x1869066294458112:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.571779:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.571784:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47834f expref: 545 pid: 213217 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.571794:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47834f expref: 545 pid: 213217 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.571815:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:3.0:1782487606.571819:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.571826:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.571832:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.571847:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+545:2363:x1869066294458112:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 76us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.571854:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6550 00000100:00100000:3.0:1782487606.571865:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6551 00000100:00100000:3.0:1782487606.571871:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549165f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+544:2361:x1869066294457856:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.571878:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.571882:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47844b expref: 544 pid: 190303 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.571891:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47844b expref: 544 pid: 190303 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.571902:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:3.0:1782487606.571905:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.571912:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.571926:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.571940:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549165f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+544:2361:x1869066294457856:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 69us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.571946:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6551 00000100:00100000:0.0:1782487606.572089:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487606.572199:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47841a expref: 543 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.572215:0:213218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb45a53f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299321472:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.572225:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47844b expref: 542 pid: 190303 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.572237:0:213218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb45a53f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299321600:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.572245:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47834f expref: 541 pid: 213217 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.572265:0:213218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573532a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299321728:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487606.572274:0:213218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573530a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299321856:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.572302:0:213218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.572682:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294458240 00000100:00100000:3.0:1782487606.572686:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294458240 00010000:00010000:3.0:1782487606.572704:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783e9 expref: 541 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.572741:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6552 00000100:00100000:3.0:1782487606.572749:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+541:2361:x1869066294458240:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.572757:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.572761:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783e9 expref: 541 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.572772:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783e9 expref: 541 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.572785:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783e9 expref: 541 pid: 213216 timeout: 7333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.572796:0:192468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:3.0:1782487606.572800:0:192468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.572808:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.572821:0:192468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.572849:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.572873:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+540:2361:x1869066294458240:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 126us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.572880:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6552 00010000:00010000:0.0:1782487606.573049:0:213218:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.573057:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487606.573552:0:213218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2557, 64 off171840 00010000:00010000:0.0:1782487606.573626:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef73 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.573638:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.573646:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.573654:0:213218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef73 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.573660:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef73 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.573666:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.573692:0:213218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487606.573706:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487606.573712:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef73 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.573713:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.573719:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.573725:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.577085:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487606.577093:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef73 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.577103:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.577117:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:3.0:1782487606.577120:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487606.577124:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef73 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.577131:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ef73 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.577146:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.577147:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.577150:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.580060:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.580070:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.580080:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.580095:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:0.0:1782487606.580097:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487606.580101:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.580108:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef6c lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.580131:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.580138:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef5e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.580163:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef5e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.580168:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.580171:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef5e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.580177:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef5e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.580184:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.580186:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.580189:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef5e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.580196:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef5e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487606.580206:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026ca8ad0 reply state 0000000032d65616 transno 8589957026 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.580216:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487606.580300:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+75:295211:x1869066294457600:12345-192.168.202.21@tcp:36:rm.0 Request processed in 16416us (16509us total) trans 8589957026 rc 0/0 00000100:00100000:0.0:1782487606.580309:0:213218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1892 00010000:00010000:3.0:1782487606.582715:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.582734:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.582741:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.582748:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487606.582753:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.582760:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef65 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.582774:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4c4862100) 00010000:00010000:3.0:1782487606.582777:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487606.582781:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef65 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.582787:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85ef65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.582864:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.583057:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294458368 00000100:00100000:0.0:1782487606.583064:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294458368 00000100:00100000:0.0:1782487606.583104:0:196437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1893 00000100:00100000:0.0:1782487606.583112:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+74:295211:x1869066294458368:12345-192.168.202.21@tcp:101:rm.0 00010000:00010000:0.0:1782487606.583140:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487606.583154:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef7a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478555 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583207:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef81 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583220:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef81 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583230:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef81 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583243:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ef88 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583250:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ef88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583257:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ef88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583347:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef8f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583376:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583383:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487606.583416:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb15:0x0]: returning size 0 00000004:00200000:0.0:1782487606.583425:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487606.583444:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583455:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583463:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef81 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583469:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef81 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583475:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583480:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.583483:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583489:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583496:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.583499:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.583502:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583508:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ef81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583517:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ef88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583532:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ef88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583538:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ef88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583543:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.583546:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ef88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583552:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ef88 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583558:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4c4862900) 00010000:00010000:0.0:1782487606.583560:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.583563:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ef88 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583568:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ef88 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583592:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ef7a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478555 expref: 76 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583603:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478555 expref: 75 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.583627:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:0.0:1782487606.583629:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487606.583637:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e000, rc 0) 00000100:00100000:0.0:1782487606.583682:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+75:295211:x1869066294458368:12345-192.168.202.21@tcp:101:rm.0 Request processed in 570us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.583689:0:196437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1893 00000100:00100000:0.0:1782487606.587096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.587125:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294458624 00000100:00100000:0.0:1782487606.587132:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294458624 00000100:00100000:0.0:1782487606.587179:0:213684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1894 00000100:00100000:0.0:1782487606.587187:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+75:295211:x1869066294458624:12345-192.168.202.21@tcp:36:rm.0 00010000:00010000:0.0:1782487606.587237:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487606.587259:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85ef8f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478555 expref: 75 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587276:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:0.0:1782487606.587280:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487606.587297:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef96 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587310:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef96 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587319:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef96 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587333:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587339:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587361:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587451:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587460:0:213684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783cd expref: 539 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587469:0:213684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783c6 expref: 539 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587478:0:213684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478341 expref: 539 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587486:0:213684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47843d expref: 539 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587494:0:213684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47840c expref: 539 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587501:0:213684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 8/0,1 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587531:0:213684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47840c expref: 539 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587543:0:213684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47840c expref: 539 pid: 213216 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.587562:0:213684:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573532a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299321984:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.587657:0:213684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47843d expref: 539 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587665:0:213684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47843d expref: 539 pid: 190303 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.587673:0:213684:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573530000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299322112:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.587701:0:213684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478341 expref: 539 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587710:0:213684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478341 expref: 539 pid: 213217 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.587718:0:213684:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299322240:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.587750:0:213684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783c6 expref: 539 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587759:0:213684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783c6 expref: 539 pid: 213216 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.587768:0:213684:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573533480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299322368:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.587797:0:213684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783cd expref: 539 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.587812:0:213684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783cd expref: 539 pid: 190303 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.587821:0:213684:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299322496:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487606.587840:0:213684:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb544e879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487606.590574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.590637:0:213684:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573532a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299321984:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487606.590643:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294458752 00000100:00100000:3.0:1782487606.590649:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294458752 00010000:00010000:3.0:1782487606.590682:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47840c expref: 540 pid: 213216 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.590723:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6553 00000100:00100000:3.0:1782487606.590733:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+540:2360:x1869066294458752:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.590758:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.590765:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47840c expref: 540 pid: 213216 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.590777:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47840c expref: 540 pid: 213216 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.590794:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47840c expref: 540 pid: 213216 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.590809:0:190283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:3.0:1782487606.590814:0:190283:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.590823:0:190283:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.590829:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.590873:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+539:2360:x1869066294458752:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 142us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.590881:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6553 00000100:00100000:3.0:1782487606.593753:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6385baa4-edbe-4eae-af92-80250729af95:3317:1869066299322624:0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.593809:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487606.593834:0:190290:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299322624 00000100:00100000:3.0:1782487606.593838:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066299323136:0@lo:400:kworker.0 00000100:00100000:0.0:1782487606.593840:0:190290:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299322624 00000100:00100000:3.0:1782487606.593862:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487606.593879:0:190290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1782487606.593883:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782487606.593886:0:190290:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6385baa4-edbe-4eae-af92-80250729af95+19:3317:x1869066299322624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.593888:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066299323008:0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.593920:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487606.593925:0:190290:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6385baa4-edbe-4eae-af92-80250729af95+19:3317:x1869066299322624:12345-0@lo:400:kworker.0 Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.593932:0:190290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1782487606.593946:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6385baa4-edbe-4eae-af92-80250729af95:3317:1869066299322624:0@lo:400:kworker.0 00000100:00100000:0.0:1782487606.593965:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299323136 00000100:00100000:0.0:1782487606.593968:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299323136 00000100:00100000:3.0:1782487606.593969:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299322880:0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.593991:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487606.593996:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299323008 00000100:00100000:0.0:1782487606.593998:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299323008 00000100:00100000:3.0:1782487606.594009:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299323392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782487606.594015:0:213218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1782487606.594020:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066299323136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.594045:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487606.594064:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782487606.594068:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066299323136:12345-0@lo:400:kworker.0 Request processed in 48us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.594069:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299322752:0@lo:400:kworker.0 00000100:00100000:0.0:1782487606.594074:0:213218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1782487606.594086:0:213218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1782487606.594088:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487606.594091:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066299323008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.594102:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb560a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066299323264:0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.594119:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487606.594122:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066299323008:12345-0@lo:400:kworker.0 Request processed in 31us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.594128:0:213218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1782487606.594138:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299323264 00000100:00100000:3.0:1782487606.594140:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299322880 00000100:00100000:0.0:1782487606.594141:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299323264 00000100:00100000:3.0:1782487606.594143:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299322880 00000100:00100000:0.0:1782487606.594155:0:213218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1782487606.594159:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066299323264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.594168:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299322752 00000100:00100000:3.0:1782487606.594170:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299322752 00000100:00100000:0.0:1782487606.594189:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066299323264:12345-0@lo:400:kworker.0 Request processed in 30us (69us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.594190:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1782487606.594196:0:213218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1782487606.594197:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299322880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782487606.594212:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1782487606.594218:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299322752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.594223:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299322880:12345-0@lo:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.594229:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1782487606.594240:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299322752:12345-0@lo:400:kworker.0 Request processed in 23us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.594246:0:190933:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299323392 00000100:00100000:0.0:1782487606.594246:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1782487606.594248:0:190933:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299323392 00000100:00080000:0.0:1782487606.594265:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782487606.594268:0:190933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00080000:0.0:1782487606.594269:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782487606.594271:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782487606.594274:0:190933:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299323392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782487606.594299:0:190933:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 37158912 pending 0 free 3818913792 avail 3816816640 00000100:00100000:3.0:1782487606.594329:0:190933:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299323392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.594341:0:190933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1782487606.594367:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299322752:0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.594376:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb560a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066299323264:0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.594384:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299322880:0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.594395:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299323392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782487606.594420:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066299323008:0@lo:400:kworker.0 00000100:00100000:3.0:1782487606.594428:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066299323136:0@lo:400:kworker.0 00000100:00100000:0.0:1782487606.596134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.596160:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.596177:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.596242:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.596265:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294459008 00000100:00100000:0.0:1782487606.596271:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294459008 00010000:00010000:0.0:1782487606.596294:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783cd expref: 539 pid: 190303 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.596318:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294458880 00000100:00100000:0.0:1782487606.596326:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294458880 00010000:00010000:0.0:1782487606.596337:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478341 expref: 540 pid: 213217 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.596352:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294459136 00000100:00100000:0.0:1782487606.596354:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294459136 00010000:00010000:0.0:1782487606.596365:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783c6 expref: 541 pid: 213216 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.596377:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294459264 00000100:00100000:0.0:1782487606.596380:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294459264 00010000:00010000:0.0:1782487606.596388:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47843d expref: 542 pid: 190303 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.596401:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6554 00000100:00100000:0.0:1782487606.596407:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+542:2363:x1869066294459008:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487606.596419:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487606.596425:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783cd expref: 542 pid: 190303 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.596436:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783cd expref: 542 pid: 190303 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.596454:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:0.0:1782487606.596459:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.596467:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.596483:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487606.596516:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+542:2363:x1869066294459008:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 109us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.596523:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6554 00000100:00100000:0.0:1782487606.596537:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6555 00000100:00100000:0.0:1782487606.596543:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+541:2363:x1869066294458880:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487606.596549:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487606.596554:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478341 expref: 541 pid: 213217 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.596564:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478341 expref: 541 pid: 213217 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.596574:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:0.0:1782487606.596578:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.596585:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.596591:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487606.596603:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+541:2363:x1869066294458880:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 61us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.596627:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6555 00000100:00100000:0.0:1782487606.596639:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6556 00000100:00100000:0.0:1782487606.596645:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579990850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+540:2363:x1869066294459136:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487606.596659:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487606.596664:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783c6 expref: 540 pid: 213216 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.596673:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783c6 expref: 540 pid: 213216 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.596682:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6557 00010000:00010000:0.0:1782487606.596683:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:0.0:1782487606.596687:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.596691:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+540:2361:x1869066294459264:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487606.596693:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.596698:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487606.596699:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.596703:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47843d expref: 540 pid: 190303 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.596713:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47843d expref: 540 pid: 190303 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.596713:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579990850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+540:2363:x1869066294459136:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 69us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487606.596720:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6556 00010000:00010000:3.0:1782487606.596724:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:3.0:1782487606.596728:0:192469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.596734:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.596741:0:192469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.596763:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.596780:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+539:2361:x1869066294459264:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 92us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.596787:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6557 00010000:00010000:0.0:1782487606.596847:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47843d expref: 538 pid: 190303 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.596863:0:213684:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573530000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299322112:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.596875:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478341 expref: 537 pid: 213217 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.596885:0:213684:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299322240:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.596894:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783c6 expref: 536 pid: 213216 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.596910:0:213684:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573533480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299322368:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.596921:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783cd expref: 535 pid: 190303 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.596930:0:213684:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299322496:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.596950:0:213684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.596959:0:213684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.596965:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487606.598498:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2563, 64 off172224 00010000:00010000:0.0:1782487606.598557:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85efab lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598570:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85efab lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598578:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85efab lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598586:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85efab lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598593:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85efab lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598622:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85efab lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598638:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487606.598657:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598663:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598670:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598675:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.598679:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598687:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598698:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:0.0:1782487606.598701:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487606.598704:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598710:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efa4 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598726:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef96 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598742:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef96 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598749:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef96 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598754:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.598757:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef96 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598764:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef96 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598772:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.598774:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.598777:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef96 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598783:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ef96 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487606.598793:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049f1c6a9 reply state 00000000d395b71b transno 8589957027 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.598802:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487606.598859:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+76:295211:x1869066294458624:12345-192.168.202.21@tcp:36:rm.0 Request processed in 11670us (11767us total) trans 8589957027 rc 0/0 00000100:00100000:0.0:1782487606.598867:0:213684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1894 00010000:00010000:0.0:1782487606.598889:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487606.598894:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85efab lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598905:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487606.598908:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85efab lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598915:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85efab lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598923:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:0.0:1782487606.598925:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782487606.598928:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85efab lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598934:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85efab lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.598942:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.598944:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.598946:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.600638:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.600649:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.600656:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.600662:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fe00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487606.600666:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.600673:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef9d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.600683:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4c4862400) 00010000:00010000:3.0:1782487606.600686:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487606.600689:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef9d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.600695:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ef9d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.601687:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.601712:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294459520 00000100:00100000:0.0:1782487606.601719:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294459520 00000100:00100000:0.0:1782487606.601755:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5807 00000100:00100000:0.0:1782487606.601762:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+75:295211:x1869066294459520:12345-192.168.202.21@tcp:35:rm.0 00000100:00100000:0.0:1782487606.601934:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+76:295211:x1869066294459520:12345-192.168.202.21@tcp:35:rm.0 Request processed in 172us (250us total) trans 8589957028 rc 0/0 00000100:00100000:0.0:1782487606.601942:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5807 00000100:00100000:0.0:1782487606.604080:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487606.604102:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294459776 00000100:00100000:0.0:1782487606.604116:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294459776 00000100:00100000:0.0:1782487606.604148:0:213218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1895 00000100:00100000:0.0:1782487606.604154:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+76:295211:x1869066294459776:12345-192.168.202.21@tcp:36:rm.0 00010000:00010000:0.0:1782487606.604196:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782487606.604217:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85eec4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478539 expref: 76 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.604264:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb452642a00/0x66475b4e8b79b85d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a442331 expref: 75 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.604275:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.604285:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151b800/0x66475b4e8b79b81e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a442323 expref: 74 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.604293:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cb44981b800) 00010000:00010000:0.0:1782487606.604297:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487606.604313:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.604324:0:213218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834d600/0x66475b4e8b79bbcf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a442426 expref: 534 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.604332:0:213218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.604359:0:213218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834d600/0x66475b4e8b79bbcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a442426 expref: 534 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.604372:0:213218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834d600/0x66475b4e8b79bbcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a442426 expref: 534 pid: 190298 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.604390:0:213218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299323520:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487606.604443:0:213218:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb544e879c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782487606.606256:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487606.606284:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294459904 00000100:00100000:3.0:1782487606.606295:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294459904 00010000:00010000:3.0:1782487606.606359:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834d600/0x66475b4e8b79bbcf lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a442426 expref: 535 pid: 190298 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.606385:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6558 00000100:00100000:3.0:1782487606.606393:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+535:2360:x1869066294459904:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.606403:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.606408:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834d600/0x66475b4e8b79bbcf lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a442426 expref: 535 pid: 190298 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.606419:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834d600/0x66475b4e8b79bbcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a442426 expref: 535 pid: 190298 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.606436:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cb44981b800) 00010000:00010000:3.0:1782487606.606440:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.606449:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.606457:0:192528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.606469:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.606496:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+535:2360:x1869066294459904:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 104us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.606503:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6558 00010000:00010000:0.0:1782487606.606705:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834d600/0x66475b4e8b79bbcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a442426 expref: 534 pid: 190298 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.606718:0:213218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299323520:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.606733:0:213218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.606742:0:213218:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.606748:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.606765:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85efb9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.606773:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85efb9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.606780:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85efb9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.606991:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.607002:0:213218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ba00/0x66475b4e8b79bc07 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a442434 expref: 533 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.607015:0:213218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.607049:0:213218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ba00/0x66475b4e8b79bc07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a442434 expref: 533 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.607060:0:213218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ba00/0x66475b4e8b79bc07 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a442434 expref: 533 pid: 190298 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.607071:0:213218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299323648:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487606.607114:0:213218:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb544e879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487606.609106:0:213218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299323648:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487606.609124:0:213218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.609750:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487606.609789:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294460032 00000100:00100000:3.0:1782487606.609796:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294460032 00010000:00010000:3.0:1782487606.609832:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ba00/0x66475b4e8b79bc07 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a442434 expref: 534 pid: 190298 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.609867:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6559 00000100:00100000:3.0:1782487606.609875:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+534:2361:x1869066294460032:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.609885:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487606.609891:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ba00/0x66475b4e8b79bc07 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a442434 expref: 534 pid: 190298 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.609902:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ba00/0x66475b4e8b79bc07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a442434 expref: 534 pid: 190298 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.610073:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ba00/0x66475b4e8b79bc07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a442434 expref: 534 pid: 190298 timeout: 7334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.610086:0:192468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487606.610091:0:192468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.610100:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.610107:0:192468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.610132:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487606.610166:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+533:2361:x1869066294460032:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 291us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.610173:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6559 00010000:00010000:0.0:1782487606.610538:0:213218:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.610546:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487606.611142:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x35:0x0]: returning size 7680 00010000:00010000:0.0:1782487606.611157:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611164:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611176:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611182:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.611186:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611194:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611203:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487606.611206:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487606.611209:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611216:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b85efc0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611233:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611239:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611245:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611250:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487606.611253:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611268:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611276:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cb44981b800) 00010000:00010000:0.0:1782487606.611278:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487606.611280:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.611286:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85efb2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487606.611298:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cbe87e7d reply state 00000000ef554170 transno 8589957029 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85efb9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.611306:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487606.611359:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+75:295211:x1869066294459776:12345-192.168.202.21@tcp:36:rm.0 Request processed in 7204us (7282us total) trans 8589957029 rc 0/0 00000100:00100000:0.0:1782487606.611367:0:213218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1895 00010000:00010000:3.0:1782487606.615791:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85efb9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.615807:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85efb9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.615814:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85efb9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.615821:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487606.615825:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85efb9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.615833:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85efb9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.615847:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xac38cf7d (ffff9cb4c4862900) 00010000:00010000:3.0:1782487606.615850:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487606.615854:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85efb9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.615861:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85efb9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.663584:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487607.378873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487607.378921:0:213491:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294460160 00000100:00100000:3.0:1782487607.378931:0:213491:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294460160 00000100:00100000:3.0:1782487607.378988:0:213491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1174 00000100:00100000:3.0:1782487607.379001:0:213491:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+74:2363:x1869066294460160:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487607.379056:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487607.379080:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85efc7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47855c expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487607.379215:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-116, rc=-116) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85efc7 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47855c expref: 75 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487607.379231:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb579f0fd00) 00010000:00010000:3.0:1782487607.379235:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487607.379241:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85efc7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47855c expref: 75 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487607.379263:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4de691400, rc -116) 00000100:00100000:3.0:1782487607.379326:0:213491:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+74:2363:x1869066294460160:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 328us (470us total) trans 0 rc -116/-116 00000100:00100000:3.0:1782487607.379336:0:213491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1174 00000004:00080000:0.0:1782487607.619060:0:190320:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7235040450777ns, next at 7236040447699ns, rc = 0 00000100:00100000:0.0:1782487607.619093:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299323776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782487607.619216:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487607.619295:0:190932:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299323776 00000100:00100000:0.0:1782487607.619302:0:190932:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299323776 00000100:00100000:0.0:1782487607.619360:0:190932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1782487607.619370:0:190932:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066299323776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782487607.619402:0:190932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 37158912 pending 0 free 3847225344 avail 3845128192 00000100:00100000:0.0:1782487607.619449:0:190932:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066299323776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487607.619464:0:190932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1782487607.619535:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299323776:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782487607.681704:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487608.173150:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 117 committed 00000001:00080000:2.0:1782487608.173179:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589957029 is committed 00000004:00080000:2.0:1782487608.173197:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 110 committed 00000004:00080000:2.0:1782487608.173211:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 116 committed 00000100:00100000:0.0:1782487608.173378:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299323904:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487608.173381:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299324032:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487608.173667:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487608.173671:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299324160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487608.173711:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487608.173755:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487608.173767:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299323904 00000100:00100000:0.0:1782487608.173775:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299323904 00000100:00100000:3.0:1782487608.173826:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299324160 00000100:00100000:3.0:1782487608.173832:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299324160 00000100:00100000:0.0:1782487608.173862:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299324032 00000100:00100000:0.0:1782487608.173867:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299324032 00000100:00100000:3.0:1782487608.173873:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16640 00000100:00100000:3.0:1782487608.173886:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066299323904:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487608.173898:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16641 00000100:00100000:0.0:1782487608.173908:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299324160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782487608.173911:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6276 count 1 00002000:00080000:0.0:1782487608.173933:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6238 count 1 00010000:00010000:3.0:1782487608.173935:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487608.173961:0:213227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x185e:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487608.173969:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4301079/0x66475b4e8b85e253 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784ad expref: 6 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487608.173970:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85efd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.173988:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1884:0x0].0x0 since=22s v=(0 0) 00010000:00010000:0.0:1782487608.173991:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185e:0x0].0x0 since=7235s v=(0 0) 00010000:00010000:3.0:1782487608.173994:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1884:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487608.173997:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487608.174000:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487608.174004:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85efd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487608.174037:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85efd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.174048:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4301079/0x66475b4e8b85e253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784ad expref: 6 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487608.174050:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85efd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.174075:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4301079/0x66475b4e8b85e253 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784ad expref: 6 pid: 213210 timeout: 7335 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487608.174091:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85efd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487608.174098:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299324288:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487608.174113:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487608.174169:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb450da13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782487608.174196:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16642 00000100:00100000:3.0:1782487608.174207:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3314:x1869066299324032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782487608.174221:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6275 count 1 00010000:00010000:3.0:1782487608.174235:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.174247:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f1c2a4d/0x66475b4e8b85e24c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784a6 expref: 6 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.174266:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1883:0x0].0x0 since=22s v=(0 0) 00010000:00010000:3.0:1782487608.174269:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1883:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487608.174274:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.174296:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f1c2a4d/0x66475b4e8b85e24c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784a6 expref: 6 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.174306:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f1c2a4d/0x66475b4e8b85e24c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784a6 expref: 6 pid: 213210 timeout: 7335 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487608.174317:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299324416:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487608.174347:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb450da10c0 going to sleep for 11 seconds 00010000:00010000:3.0:1782487608.174370:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487608.174376:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85efd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.174384:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487608.174390:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85efd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.174400:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85efd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.174429:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85efd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.174438:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85efd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.174461:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487608.174464:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487608.174468:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487608.174831:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066299324160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 924us (1119us total) trans 8589940195 rc 0/0 00000100:00100000:0.0:1782487608.174839:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16641 00000100:00080000:0.0:1782487608.174872:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782487608.174876:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1782487608.174888:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb96a00/2, rc 0, transno 8589940195 00000100:00100000:3.0:1782487608.174911:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299324160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487608.178076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487608.178111:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487608.178162:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299324416:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487608.178185:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487608.178212:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299324288:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487608.178234:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487608.178267:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294460288 00000100:00100000:3.0:1782487608.178274:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294460288 00010000:00010000:3.0:1782487608.178315:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4301079/0x66475b4e8b85e253 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784ad expref: 7 pid: 213210 timeout: 7335 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487608.178346:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294460416 00000100:00100000:3.0:1782487608.178350:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294460416 00010000:00010000:3.0:1782487608.178365:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f1c2a4d/0x66475b4e8b85e24c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784a6 expref: 8 pid: 213210 timeout: 7335 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487608.178410:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6560 00000100:00100000:3.0:1782487608.178421:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+8:2362:x1869066294460288:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487608.178433:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487608.178441:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4301079/0x66475b4e8b85e253 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784ad expref: 8 pid: 213210 timeout: 7335 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.178454:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4301079/0x66475b4e8b85e253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784ad expref: 8 pid: 213210 timeout: 7335 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.178696:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4301079/0x66475b4e8b85e253 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784ad expref: 8 pid: 213210 timeout: 7335 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.178713:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1884:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487608.178717:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1884:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487608.178723:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.178732:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.178756:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487608.178798:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:2362:x1869066294460288:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 379us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487608.178807:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6560 00000100:00100000:3.0:1782487608.178836:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6561 00000100:00100000:3.0:1782487608.178846:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:2362:x1869066294460416:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487608.178855:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487608.178861:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f1c2a4d/0x66475b4e8b85e24c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784a6 expref: 6 pid: 213210 timeout: 7335 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.178874:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f1c2a4d/0x66475b4e8b85e24c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784a6 expref: 6 pid: 213210 timeout: 7335 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.178889:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f1c2a4d/0x66475b4e8b85e24c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784a6 expref: 6 pid: 213210 timeout: 7335 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.178901:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1883:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487608.178905:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1883:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487608.178910:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.178918:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.178940:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487608.178963:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:2362:x1869066294460416:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 120us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487608.178971:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6561 00010000:00010000:3.0:1782487608.179037:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.179057:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.179067:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.179076:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.179094:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487608.179915:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1869066299323904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6030us (6248us total) trans 8589940884 rc 0/0 00000100:00100000:3.0:1782487608.179925:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16640 00010000:00010000:3.0:1782487608.181065:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.181077:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.181088:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.181096:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.182113:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1782487608.182881:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3314:x1869066299324032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8676us (9124us total) trans 8589940885 rc 0/0 00000100:00100000:3.0:1782487608.182891:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16642 00010000:00010000:3.0:1782487608.182923:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782487608.182929:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.182941:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487608.182945:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.182957:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.182976:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.182985:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85efce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.183007:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487608.183021:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.183041:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487608.183045:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.183054:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.183067:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.183075:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a45cda86/0x66475b4e8b85efdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487608.183101:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487608.183105:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487608.183108:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782487608.183147:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e6680/2, rc 0, transno 8589940884 00000100:00100000:3.0:1782487608.183154:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299323904:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487608.183177:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782487608.183214:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e4380/2, rc 0, transno 8589940885 00000100:00100000:3.0:1782487608.183220:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299324032:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1782487608.183241:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782487608.712789:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487609.729685:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782487610.200674:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589940885 is committed 00000001:00080000:2.0:1782487610.718459:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940195 is committed 00010000:00010000:3.0:1782487610.753701:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782487610.796689:0:217034:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77s: Check TBF LRU shrinker ============== 11:26:50 (1782487610) 00000100:00100000:3.0:1782487610.845843:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487610.845884:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294460544 00000100:00100000:3.0:1782487610.845891:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294460544 00000100:00100000:3.0:1782487610.845935:0:190296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1896 00000100:00100000:3.0:1782487610.845945:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+65:295491:x1869066294460544:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1782487610.845963:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487610.845981:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85efe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478563 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.846047:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85efea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.846058:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85efea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.846067:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85efea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487610.846138:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 71168 00000004:00200000:3.0:1782487610.846143:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 82 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487610.846172:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85efea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.846197:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85efe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478563 expref: 67 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.846215:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85efea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478563 expref: 66 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.846224:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cb579f0f700) 00010000:00010000:3.0:1782487610.846228:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782487610.846237:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4de691800, rc 0) 00000100:00100000:3.0:1782487610.846305:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+66:295491:x1869066294460544:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 361us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487610.846314:0:190296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1896 00000100:00080000:3.0:1782487610.846340:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782487610.857013:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487610.857058:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294460672 00000100:00100000:3.0:1782487610.857066:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294460672 00000100:00100000:3.0:1782487610.857124:0:213935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1897 00000100:00100000:3.0:1782487610.857136:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+66:295491:x1869066294460672:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1782487610.857155:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487610.857173:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85eff1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47856a expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857231:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85eff8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857245:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85eff8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857256:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85eff8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857272:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690200/0x66475b4e8b85efff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857280:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690200/0x66475b4e8b85efff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857287:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690200/0x66475b4e8b85efff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857470:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85eff8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857479:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85eff8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857486:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85eff8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857493:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487610.857498:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85eff8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857506:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85eff8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857520:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cb579f0f700) 00010000:00010000:3.0:1782487610.857524:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487610.857529:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85eff8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857536:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85eff8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857550:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690200/0x66475b4e8b85efff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857557:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690200/0x66475b4e8b85efff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857564:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690200/0x66475b4e8b85efff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857576:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487610.857581:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690200/0x66475b4e8b85efff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857588:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690200/0x66475b4e8b85efff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857598:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ba845f (ffff9cb579f0fd00) 00010000:00010000:3.0:1782487610.857602:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487610.857626:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690200/0x66475b4e8b85efff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857634:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690200/0x66475b4e8b85efff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857673:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85eff1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47856a expref: 67 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857685:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cb579f0f700) 00010000:00010000:3.0:1782487610.857687:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487610.857692:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85eff1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47856a expref: 67 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.857703:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4de690e00, rc 0) 00000100:00100000:3.0:1782487610.857756:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+66:295491:x1869066294460672:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 621us (750us total) trans 0 rc 301/301 00000100:00100000:3.0:1782487610.857765:0:213935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1897 00000100:00100000:3.0:1782487610.863809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487610.864110:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294460928 00000100:00100000:0.0:1782487610.864119:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294460928 00000100:00100000:0.0:1782487610.864167:0:196437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1898 00000100:00100000:0.0:1782487610.864175:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+66:295491:x1869066294460928:12345-192.168.202.21@tcp:36:lfs.0 00010000:00010000:0.0:1782487610.864223:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487610.864247:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85efea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478563 expref: 66 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487610.864263:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cb579f0f700) 00010000:00010000:0.0:1782487610.864272:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487610.864359:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0c00/0x66475b4e8b85f006 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487610.864370:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0c00/0x66475b4e8b85f006 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487610.864377:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0c00/0x66475b4e8b85f006 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487610.864393:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85f00d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487610.864399:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85f00d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487610.864404:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85f00d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487610.865382:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb4e:0x0]: returning size 512 00010000:00010000:0.0:1782487610.865393:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0c00/0x66475b4e8b85f006 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487610.865399:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0c00/0x66475b4e8b85f006 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487610.865404:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0c00/0x66475b4e8b85f006 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487610.865409:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb0c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487610.865413:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0c00/0x66475b4e8b85f006 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487610.865418:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0c00/0x66475b4e8b85f006 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487610.865429:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cb4c4862c00) 00010000:00010000:0.0:1782487610.865431:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487610.865434:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0c00/0x66475b4e8b85f006 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487610.865445:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0c00/0x66475b4e8b85f006 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487610.865465:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002ae88eb5 reply state 00000000aa82b666 transno 8589957030 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85f00d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487610.865474:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487610.865563:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:295491:x1869066294460928:12345-192.168.202.21@tcp:36:lfs.0 Request processed in 1386us (1759us total) trans 8589957030 rc 0/0 00000100:00100000:0.0:1782487610.865573:0:196437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1898 00010000:00010000:3.0:1782487610.869885:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85f00d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.869903:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85f00d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.869912:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85f00d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.869920:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487610.869926:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85f00d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.869935:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85f00d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.869954:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ba845f (ffff9cb4c4862b00) 00010000:00010000:3.0:1782487610.869958:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487610.869964:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85f00d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487610.869971:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85f00d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487610.966448:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0F:1782487610.966497:0:213217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294461056 00000100:00100000:1.0:1782487610.966511:0:213217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294461056 00000100:00100000:3.0:1782487610.966516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487610.966547:0:190291:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294461184 00000100:00100000:0.0:1782487610.966553:0:190291:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294461184 00000100:00100000:3.0:1782487610.966559:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487610.966572:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1175 00000100:00100000:1.0:1782487610.966584:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+533:2361:x1869066294461056:12345-192.168.202.21@tcp:63:ll_sa.0 00000100:00100000:0.0:1782487610.966598:0:190291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 340 00000100:00100000:3.0:1782487610.966601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487610.966631:0:190291:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60894528-77cf-40cf-92ce-b54cc4bbae30+13:2360:x1869066294461184:12345-192.168.202.21@tcp:400:kworker.0 00010000:00010000:1.0:1782487610.966640:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487610.966662:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8000/0x66475b4e8b85f014 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478571 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487610.966697:0:190291:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60894528-77cf-40cf-92ce-b54cc4bbae30+13:2360:x1869066294461184:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487610.966705:0:190291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 340 00000100:00100000:0.0:1782487610.966753:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294461312 00000100:00100000:0.0:1782487610.966757:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294461312 00010000:00010000:1.0:1782487610.966783:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-116, rc=-116) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8000/0x66475b4e8b85f014 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478571 expref: 534 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487610.966796:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb541321d00) 00000100:00100000:0.0:1782487610.966800:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294461568 00010000:00010000:1.0:1782487610.966803:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1782487610.966804:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487610.966805:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294461568 00010000:00010000:1.0:1782487610.966811:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8000/0x66475b4e8b85f014 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478571 expref: 534 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487610.966828:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4543a8000, rc -116) 00000100:00100000:0.0:1782487610.966833:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294461440 00000100:00100000:0.0:1782487610.966836:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294461440 00000100:00100000:0.0:1782487610.966863:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 278 00000100:00100000:0.0:1782487610.966872:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:2360:x1869066294461568:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1782487610.966880:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+533:2361:x1869066294461056:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 300us (441us total) trans 0 rc -116/-116 00000100:00100000:1.0:1782487610.966888:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1175 00000100:00100000:3.0:1782487610.966942:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 279 00000100:00100000:3.0:1782487610.966957:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2360:x1869066294461440:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487610.966970:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:2360:x1869066294461568:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 96us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487610.967003:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 278 00000100:00100000:0.0:1782487610.967022:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16643 00000100:00100000:0.0:1782487610.967031:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2359:x1869066294461312:12345-192.168.202.21@tcp:9:kworker.0 00000100:00080000:1.0:1782487610.967047:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1782487610.967049:0:190931:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x66475b4e8b79b91a 00000100:00080000:1.0:1782487610.967051:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782487610.967058:0:190931:0:(import.c:65:import_set_state_nolock()) ffff9cb56e17e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782487610.967091:0:190931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589940885 00000100:00100000:3.0:1782487610.967162:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2360:x1869066294461440:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 210us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487610.967172:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 279 00000100:00100000:1.0:1782487610.967195:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487610.967367:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+2:2359:x1869066294461312:12345-192.168.202.21@tcp:9:kworker.0 Request processed in 336us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487610.967375:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16643 00000100:00100000:0.0:1782487610.967389:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294461696 00000100:00100000:0.0:1782487610.967392:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294461696 00000100:00100000:0.0:1782487610.967422:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 280 00000100:00100000:0.0:1782487610.967429:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:2360:x1869066294461696:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487610.967467:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:2360:x1869066294461696:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 39us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487610.967473:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 280 00010000:00010000:0.0:1782487610.967497:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782487610.967506:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782487611.476318:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487611.476358:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294461824 00000100:00100000:1.0:1782487611.476366:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294461824 00000100:00100000:1.0:1782487611.476414:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1176 00000100:00100000:1.0:1782487611.476424:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+66:2363:x1869066294461824:12345-192.168.202.21@tcp:63: 00010000:00010000:1.0:1782487611.476476:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487611.476498:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85f01b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478578 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487611.476690:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-116, rc=-116) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85f01b lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478578 expref: 67 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487611.476705:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb541321d00) 00010000:00010000:1.0:1782487611.476708:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487611.476713:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85f01b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478578 expref: 67 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487611.476729:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4543a8a00, rc -116) 00000100:00100000:1.0:1782487611.476787:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+66:2363:x1869066294461824:12345-192.168.202.21@tcp:63: Request processed in 364us (477us total) trans 0 rc -116/-116 00000100:00100000:1.0:1782487611.476794:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1176 00000100:00100000:0.0:1782487611.718170:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6385baa4-edbe-4eae-af92-80250729af95:3316:1869066299324672:0@lo:400:kworker.0 00000004:00080000:1.0:1782487611.718185:0:190322:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7239139575948ns, next at 7240139515244ns, rc = 0 00000100:00100000:1.0:1782487611.718213:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299324544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782487611.718243:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487611.718261:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487611.718293:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066299325056:0@lo:400:kworker.0 00000100:00100000:1.0:1782487611.718299:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066299325184:0@lo:400:kworker.0 00000100:00100000:0.0:1782487611.718334:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487611.718359:0:198596:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299324544 00000100:00100000:1.0:1782487611.718368:0:198596:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299324544 00000100:00100000:0.0:1782487611.718384:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299324800:0@lo:400:kworker.0 00000100:00100000:0.0:1782487611.718419:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487611.718435:0:198596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1782487611.718462:0:198596:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066299324544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782487611.718475:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299325056 00000100:00100000:3.0:1782487611.718481:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299325056 00002000:00000024:1.0:1782487611.718497:0:198596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 37158912 pending 0 free 3818913792 avail 3816816640 00000100:00100000:3.0:1782487611.718515:0:190296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1782487611.718525:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869066299325312:0@lo:400:kworker.0 00000100:00100000:3.0:1782487611.718526:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066299325056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782487611.718559:0:198596:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066299324544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487611.718573:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487611.718579:0:198596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1782487611.718585:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066299325056:12345-0@lo:400:kworker.0 Request processed in 60us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487611.718592:0:190296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1782487611.718598:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1782487611.718624:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782487611.718628:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299324928:0@lo:400:kworker.0 00000100:00100000:3.0:1782487611.718642:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299325312 00000100:00100000:3.0:1782487611.718647:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299325312 00000100:00100000:1.0:1782487611.718647:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487611.718657:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487611.718683:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299325184 00000100:00100000:3.0:1782487611.718687:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299325184 00000100:00100000:0.0:1782487611.718695:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299324800 00000100:00100000:0.0:1782487611.718700:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299324800 00000100:00100000:1.0:1782487611.718705:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589940195 gen 2 00000100:00100000:3.0:1782487611.718713:0:190296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1782487611.718722:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869066299325312:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1782487611.718723:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb96a00, transno 8589940195 00000100:00100000:0.0:1782487611.718737:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299324928 00000100:00100000:0.0:1782487611.718741:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299324928 00000100:00100000:0.0:1782487611.718761:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1782487611.718767:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066299324800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487611.718798:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869066299325312:12345-0@lo:400:kworker.0 Request processed in 78us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487611.718805:0:190296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1782487611.718810:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066299324800:12345-0@lo:400:kworker.0 Request processed in 39us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487611.718818:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1782487611.718822:0:190296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1782487611.718832:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066299325184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782487611.718838:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1782487611.718847:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066299324928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487611.718865:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066299325184:12345-0@lo:400:kworker.0 Request processed in 35us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487611.718872:0:190296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1782487611.718887:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066299324928:12345-0@lo:400:kworker.0 Request processed in 41us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487611.718893:0:190292:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299324672 00000100:00100000:0.0:1782487611.718894:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1782487611.718898:0:190292:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299324672 00000100:00100000:3.0:1782487611.718935:0:190292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1782487611.718942:0:190292:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6385baa4-edbe-4eae-af92-80250729af95+19:3316:x1869066299324672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782487611.718960:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066299325056:0@lo:400:kworker.0 00000100:00100000:3.0:1782487611.718976:0:190292:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6385baa4-edbe-4eae-af92-80250729af95+19:3316:x1869066299324672:12345-0@lo:400:kworker.0 Request processed in 34us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487611.718998:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6385baa4-edbe-4eae-af92-80250729af95:3316:1869066299324672:0@lo:400:kworker.0 00000100:00100000:3.0:1782487611.719004:0:190292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1782487611.719289:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299324928:0@lo:400:kworker.0 00000100:00100000:1.0:1782487611.719295:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299324544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782487611.719303:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589940885 gen 2 00000004:00080000:0.0:1782487611.719308:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e6680, transno 8589940884 00000100:00100000:1.0:1782487611.719318:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066299325184:0@lo:400:kworker.0 00000004:00080000:0.0:1782487611.719319:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e4380, transno 8589940885 00000100:00100000:0.0:1782487611.719333:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299324800:0@lo:400:kworker.0 00000100:00080000:1.0:1782487611.719343:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782487611.719348:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869066299325312:0@lo:400:kworker.0 00000100:00080000:1.0:1782487611.719356:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782487611.780056:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487612.737817:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782487612.737854:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb45a53f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299325440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782487612.737961:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487612.738093:0:190933:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299325440 00000100:00100000:0.0:1782487612.738102:0:190933:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299325440 00000100:00100000:0.0:1782487612.738174:0:190933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1782487612.738187:0:190933:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066299325440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782487612.738240:0:190933:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33751040 pending 0 free 3846176768 avail 3844079616 00000100:00100000:0.0:1782487612.738300:0:190933:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066299325440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487612.738310:0:190933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1782487612.738634:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb45a53f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299325440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782487612.801797:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782487613.283046:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589957030 is committed 00000004:00080000:2.0:1782487613.283065:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 111 committed 00000100:00100000:0.0:1782487613.283144:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299325568:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487613.283210:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487613.283239:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299325568 00000100:00100000:1.0:1782487613.283246:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299325568 00000100:00100000:1.0:1782487613.283305:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16644 00000100:00100000:1.0:1782487613.283315:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066299325568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487613.283339:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6237 count 1 00010000:00010000:1.0:1782487613.283462:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487613.283484:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d60cec82/0x66475b4e8b85e25a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784b4 expref: 5 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487613.283493:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185d:0x0].0x0 since=27s v=(0 0) 00010000:00010000:1.0:1782487613.283497:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487613.283502:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487613.283527:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d60cec82/0x66475b4e8b85e25a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784b4 expref: 5 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487613.283547:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d60cec82/0x66475b4e8b85e25a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784b4 expref: 5 pid: 213223 timeout: 7340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487613.283558:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299325696:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487613.283645:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb450da1180 going to sleep for 11 seconds 00000100:00080000:1.0:1782487613.283659:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782487613.288013:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299325696:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487613.288041:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487613.288328:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487613.288409:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294461952 00000100:00100000:0.0:1782487613.288415:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294461952 00010000:00010000:0.0:1782487613.288465:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d60cec82/0x66475b4e8b85e25a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784b4 expref: 6 pid: 213223 timeout: 7340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487613.288496:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6562 00000100:00100000:0.0:1782487613.288505:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:2361:x1869066294461952:12345-192.168.202.21@tcp:103: 00010000:00010000:0.0:1782487613.288516:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487613.288520:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d60cec82/0x66475b4e8b85e25a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784b4 expref: 6 pid: 213223 timeout: 7340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487613.288536:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d60cec82/0x66475b4e8b85e25a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784b4 expref: 6 pid: 213223 timeout: 7340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487613.288555:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d60cec82/0x66475b4e8b85e25a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4784b4 expref: 6 pid: 213223 timeout: 7340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487613.288566:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487613.288570:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487613.288574:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487613.288581:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487613.288603:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487613.288634:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487613.288645:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487613.288654:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:2361:x1869066294461952:12345-192.168.202.21@tcp:103: Request processed in 151us (329us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487613.288656:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487613.288664:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6562 00010000:00010000:3.0:1782487613.288672:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782487613.288687:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782487613.288692:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487613.289282:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3316:x1869066299325568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5967us (6071us total) trans 8589940196 rc 0/0 00000100:00100000:3.0:1782487613.289298:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16644 00010000:00010000:3.0:1782487613.289328:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487613.289334:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487613.289344:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487613.289349:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487613.289360:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487613.289376:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487613.289384:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85f022 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487613.289411:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487613.289413:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487613.289416:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782487613.289445:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d6a300/2, rc 0, transno 8589940196 00000100:00100000:3.0:1782487613.289450:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299325568:0@lo:6:osp-syn-1-0.0 00000001:02000400:1.0:1782487613.326091:0:217227:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_77s: @@@@@@ FAIL: fail to start 'tbf jobid' policy 00010000:00010000:1.0:1782487613.825846:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1771 lines, 1771 kept, 0 dropped, 0 bad.